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Abstract. In nature stationary nonequilibrium systems cannot exist on their own, 
rather they need to be driven from outside in order to keep them away from equilibrium. 
While the internal mean entropy of such stationary systems is constant, the external 
drive will on average increase the entropy in the environment. This external entropy 
production is usually quantified by a simple formula, stating that each microscopic 
transition of the system between two configurations c — > d with rate w c ^ c i changes 
the entropy in the environment by AS cnv = lnw c ^ c < — lnw c /^ c . According to this 
formula irreversible transitions c — > c' with a vanishing backward rate w c >^ c = 
would produce an infinite amount of entropy. However, in experiments designed to 
mimic such processes, a divergent entropy production, that would cause an infinite 
increase of heat in the environment, is not seen. The reason is that in an experimental 
realization the backward process can be suppressed but its rate always remains slightly 
positive, resulting in a finite entropy production. The paper discusses how this entropy 
production can be estimated and specifies a lower bound depending on the observation 
time. 

E-mail: farhad@ipm.ir 
1. Introduction 

In classical statistical physics, complex systems are often modeled as continuous- 
time Markov processes in a discrete configuration space. Such systems evolve by 
spontaneous random transitions from configuration c to configuration d according to 
certain transition rates w c ^ c i. For isolated systems these rates are symmetric so that 
the model evolves into an equilibrium state with maximal entropy. For open systems, 
which interact with the surrounding environment, the transition rates are generally 
asymmetric. In this case the dynamical evolution changes not only the system's entropy 
but also the entropy in the environment. The entropy change in the environment is 
referred to as the entropy production of the system. 

As shown by Schnakenberg, Andrieux, Gaspard and Seifert [1-4], the entropy in 
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the environment S env changes discontinuously by 

AS cnv = ln^ (1) 

W&-yc 

whenever the system jumps from c to d (note that we set ks — 1 for simplicity). 
This simple formula is independent of the specific composition and structure of the 
environment, provided that it equilibrates almost instantaneously between successive 
transitions of the Markov process [5,6]. 

The entropy production formula (1) requires that for any transition c — > d with a 
non-vanishing forward rate w c ^ c i > 0, the corresponding backward rate w c >^ c has to be 
nonzero as well since otherwise the entropy production would diverge. This means that 
the definition of entropy production is only meaningful in models with microscopically 
reversible transitions. Usually it is argued that in realistic physical systems the effective 
backward rate is always nonzero since the classical description results from a coarse- 
graining of the underlying quantum-mechanical processes which are intrinsically time- 
reversible. 

However, in statistical physics a large variety of models investigated in the literature 
involve microscopically irreversible transitions. For some of these models experiments 
have been suggested or performed. A simple example is the totally asymmetric 
simple exclusion process, where particles hop only in one direction, which is studied 
experimentally by optical tweezers [7-9]. Another example is directed percolation [10], 
the standard model of a phase transition from an fluctuating phase into a frozen state, 
which was recently realized experimentally for the first time [11]. However, a divergent 
entropy production, which would manifest itself in form of a divergent increase of heat 
in the environment, has not been reported in these experiments. This suggests that this 
divergence is a theoretical artifact and needs to be regularized in a meaningful way. 

To our knowledge ben-Avraham, Dorosz and Pleimling [12] were the first to 
address this problem in detail. As a possible solution they suggest to coarse-grain the 
stochastic evolution by interval sampling: Instead of monitoring each transition event 
separately, they propose to read off the configuration at regular temporal intervals and 
to use the resulting configuration sequence to define effective transition rates. Even 
if the backward rate w c '-> c is zero, meaning that direct transitions from d to c are 
forbidden, the sampling allows the system to evolve from d to c through a loop of 
other intermediate configurations between two consecutive readings. This gives rise to 
a small but finite effective backward rate in the sampled data, regularizing the entropy 
production depending on the sampling rate. 

In this Letter we propose an alternative regularization method which is more closely 
related to the question how micro-irreversibility can be implemented in experiments. We 
start with the assertion that Eq. (1) is indeed correct and that the preceding argument 
about the fundamental impossibility of vanishing backward rates in nature remains 
valid. This means that it is in principle impossible to realize micro-irreversible processes 
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experimentally. However, in practice one can approximate irreversible processes very 
well by designing the experiment in such a way that the backward transition is strongly 
suppressed. In such an experiment the actual backward rate is positive but so small that 
the reverse transition practically never takes place during data taking. Nevertheless the 
positivity of this rate ensures that the entropy produced by the corresponding forward 
process is still finite. 

The aim of this work is to specify a lower bound on the entropy production of a 
physical system which is designed to approximate an irreversible process over a finite 
time span T. We find that the entropy production rate of such a system can be split 
into two parts, namely, a conventional constant part stemming from the reversible 
transitions, and a second part coming from the approximated irreversible transitions 
which grows logarithmically with T. 

2. Lower bound on the entropy production of micro-irreversible transitions 

Starting point is a continuous-time Markov process defined by certain set of 
configurations c G f2. The model evolves by random transitions c — > d with rates 
w c ^c' > 0, where some of the allowed transitions are microscopically irreversible, i.e. 
w c '^c = 0. Suppose that we are able to design an experiment with an identical set of 
possible configurations which approximately reproduces the Markovian dynamics of the 
model. In what follows let us distinguish between 

• the defining rates w c ^ c i of the original model, and 

• the corresponding actual rates w c ^ c > realized in the experiment. 

However, usually the actual rates in the experiment are not directly accessible, rather 
they have to be estimated from the observed number of transitions n c ^ c > during a 
finite time span T of data taking. If the system is found in the configuration d with 
probability P c ', the expectation value of this number is given by P c iw c i^ c T. Observing 
a vanishing number n c /^ c = in a single experiment does not necessarily imply that 
the corresponding actual rate w c >^ c is zero, it only means that this rate is sufficiently 
smaller than (P c iT)~ l so that this transition did not occur during data taking. 

In the following we use this framework to specify a lower bound for the entropy 
production caused by irreversible transitions in experiments with a finite observation 
time. The idea is to estimate the actual rate w of a transition c — > d in the experiment 
for a given defining rate w on the basis of the expected count numbers n c ^ c r within a 
given observation time T. In this way we want to find a physically motivated conditional 
probability distribution P(w\w) of the actual rate w for a given defining rate w. 

To determine P(w\w) let us assume that the transition c — > d occurs n times 
during the observation time T. As these events are spontaneous and uncorrelated, n is 
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randomly distributed according to a Poisson distribution 



\n„—TW 



P(n\w) = (TW) 7" , (2) 

where r = P C T is the expected time that the system spends in the configuration c. This 
allows us to express P(w\w) as 

oo 

P(w\w) = P(w\n)P(n\w) , (3) 

n=0 

where P(w\n) is the likelihood for the distribution of the actual rate w for a given 
number of transitions n. According to Bayes rule [13] this likelihood is given by 

r-w , \ P(n\w)P(w) 

p < m '"»- P („) • < 4 » 

where P(w) is the prior distribution and 

POO 

P(n)= / dwP(n\w)P{w) (5) 



the normalizing marginal likelihood. The prior P(w) expresses our belief of how the 
rates are typically distributed and therefore introduces a certain degree of ambiguity in 
the derivation. However, if no specific information about this distribution is available, 
it is customary to use the so-called conjugate prior which ensures that the posterior 
P{w\n) and the prior P(w) belong to the same family of distributions. The conjugate 
prior of a Poisson likelihood distribution P{n\w) is the Gamma distribution 

r(a) 

which depends on two hyperparameters a and (3 (the tilde is used to avoid confusion 
with rates a, (3 for various models used in the literature). With this prior the posterior 
is given by 

P(w\n) = — rr (7) 

which allows one to compute the expectation value of the actual rate for the transition 
c ->■ d 

(w) = / dw wP(w\w) = . (8) 

J T + f3 

As can be seen, this formula maps a vanishing defining rate w = onto a nonvanishing 
actual rate (w) oc 1/r. By defining r' = P c iT and inserting this expectation value into 
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the entropy production formula (1) and taking the limit T ^> 1 the entropy production 
for reversible transitions 



ASZ(c J) = In 



= ln K^ + a)/(r + ^) _ ^ ttw (Q) 
(t'w c ,^ c + a)/(r> + (3) «V-c 

reproduces the known result in Eq. (1). As our main result, for irreversible transitions 
we obtain a finite entropy production which grows logarithmically with the observation 
time 

AS:: v (c^c')= In 

= In (TW — ' + a)/ [ T ±h M l n 1^ . (10) 
a/(r' + /3) a 

Note that we have simplified the derivation by replacing (Inw) — > ln(w). However, as 
shown in Sect. 3 of the Supplemental Material [6], apart from a redefinition of a, a 
correct derivation to lowest order leads to the same result. 

The prior distribution (6) depends on two hyperparameters a and (3 which 
determine its shape and scale. Since the entropy production depends on a ratio of 
rates, the scale hyperparameter (3 drops out. However, the shape hyperparameter a 
appears in the final result and thus it has to be defined in a physically meaningful way. 
In this regard note that the Gamma distribution (6) evaluated at the origin is finite for 
<5 = 1, infinite for a < 1 and zero for a > 1. Therefore, in experiments of models with 
irreversible transitions, where the likelihood of a vanishing defining rate is expected to 
be finite, the most natural choice, which we will use from now on, is a — 1. 



3. Examples 

In what follows we study the entropy production in three exemplary nonequilibrium 
systems with micro-irreversible transitions in their steady state (further examples can 
be found in the Supplemental Material [6]). To this end we first determine the stationary 
probability distribution P c to find the system in configuration c. The average entropy 
production is then given by 

(^cnv) = ^ P c W c -+ d AS env (c -> C') , (11) 

where one has to sum over ASl^(c — > c') or AS'^ r v (c — > c') depending on whether the 
transition c — > d is reversible or irreversible. For lattice models with L sites, we define 
the average entropy production per site 



(12) 
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Figure 1. (color online) Branching-Coalescing Process (BCP) at the critical point, 
exhibiting a diffusing Bernoulli shock. Particles are represented by black pixels while 
the integrated entropy production at each site is visualized by a periodically changing 
color scale. 

TASEP: 

The first example is the Totally Asymmetric Simple Exclusion Process (TASEP) on a 
finite lattice with L sites, where particles are added at the left boundary (removed from 
the right boundary) with rate a (/?) if the first (last) lattice site is empty (occupied). 
Since particles hop exclusively to the right, all microscopic transitions are irreversible. 
The stationary probability distribution of the TASEP can be calculated exactly using 
the matrix product method [14], where the stationary weight of each configuration 
is determined by a product of noncommuting operators corresponding to the actual 
configuration. Using the exact results of Ref. [14] in the formulas (12) and (10) it turns 
out that, to leading order in T, the large- L limit of the average entropy production rate 

Senv ~ J(a,(3)\nT (13) 

is proportional to the particle current J(a, (3) in the steady state. Depending on the 
values of a and (3 the current is equal to J(a, 0) = | for a, {3 > |, J(a, j3) = a(l — a) 
for a < (3 and a < |, and J(a, (3) = (3(1 — (3) for (3 < a and j3 < |. Thus the 
average entropy production changes continuously in the parameter space and attains its 
maximum for a, /3 > | where the particle current in maximal. 

BCP: 

The second example is the Branching-Coalescing Process (BCP) on a one- dimensional 
lattice with L lattice sites and open boundaries. Each lattice site is either empty (0) or 
occupied by at most one particle (1). In the bulk the BCP evolves by the dynamical 
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rules 

01 — > 11 with rate w 
11 — > 10 with rate w 

11 ->■ 01 with rate 1 (14) 
10 ^ 11 with rate 1 
10 ->■ 01 with rate 1. 

In addition, particles are added at (removed from) the left boundary with rate a (7) 
while at the right boundary particles are removed with rate j3. 

It is known that the steady state of the BCP can be written as a linear superposition 
of Bernoulli shock measures provided that 7 = a+ ^ — 1 [15]. Moreover, under the same 
constraint it turns out that the model has a matrix product steady state [16]. Varying 
w the process undergoes a phase transition between a high- and a low-density phase at 
w c = 4. Applying the matrix product method with the two-dimensional representation 
introduced in [16], it is straightforward to calculate the average entropy production rate 
per site in the steady state. To leading order in T and in the large-L limit one finds 

f |lnT for 2(1 - a) < w < w c , 

Senv ~ \ (15) 

[0 for w > w c . 

As can be seen, the average entropy production of the BCP changes dis continuously at 
the transition point. The nonzero part of the entropy production in (15) comes from 
both reversible and irreversible processes in (14) [6]. In Fig. 1 the time evolution of 
the entropy production at each lattice site is plotted at the critical point w = w c . In 
this case the last particle in the system (the last black pixel from the left) performs an 
unbiased random walk on the lattice. It can be seen that only occupied lattice sites 
contribute to entropy production. 

AKGP: 

The third example is the one-dimensional Asymmetric Kawasaki-Glauber Process 
(AKGP) with the dynamical rules 

10 ->■ 00 with rate iui 
10 — > 11 with rate u> 2 

01 ->■ 00 with rate w 3 (16) 
01 — > 11 with rate w 4 
01 ->■ 10 with rate w 5 . 

In addition, particles are added at (removed from) the left (right) boundary with rate 
a ((3). In this model all transitions are irreversible. It is known that the AKGP has 
a matrix product steady state, which can also be written as a linear superposition of 
Bernoulli shock measures [15], and that it exhibits a phase transition at w 1 = w 2 from 
a low-density to a high-density phase. Using the two-dimensional matrix representation 
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Figure 2. Average irreversible entropy production in the AKGP as a function of W2 
for W\ — 0.4, a = 0.3, (5 — 0.1, L = 10 6 , and T = 10 6 . The phase transition occurs at 
w 2 = 0.4. 



introduced in [16], one can calculate the average entropy production rate in the limit 
L — > oo and to leading order in T, obtaining 



Since the probability of a given configuration consisting of a particle in front of an empty 
lattice site is zero in the steady state, the last three processes in (16) do not contribute to 
the average entropy production, explaining why the parameters Co> 3 , Co> 4 , u 5 do not appear 
in the result. In Fig. 2 the average entropy production rate is plotted as a function of 
W2- In contrast to the BCP, it changes continuously at the transition point. 

4. Conclusions 

In this Letter we have addressed the problem of entropy production in systems with 
irreversible transitions. For such systems the Schankenberg formula (1) predicts an 
infinite entropy production which is not seen in experiments. We suggest that the finite 
amount of entropy produced in experiments is related to the fact that vanishing reverse 
rates are impossible in nature, it is only possible to keep such rates very small. By 
introducing the concept of a 'defining rate' and an 'actual rate' and estimating the 
latter by Bayesian inference, we could specify a lower bound on the entropy production 
which splits up into a constant contribution for reversible transitions and an additional 
contribution for irreversible transitions which grows logarithmically with the observation 




(17) 



time T. 
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Using the modified entropy production formula, we have calculated the average 
entropy production rate for three exactly solvable reaction-diffusion models in the steady 
state (further examples are discussed in the Supplemental Material [6]). The steady 
state of the BCP and AKGP are very similar in the sense that they both can be 
written as a linear superposition of Bernoulli shock measures, where the shock performs 
a simple random walk [15]. However, the average entropy production behaves quite 
differently, namely, discontinuously in the BCP and continuously in the AKGP. This 
suggests that the irreversible entropy production may be used as an additional tool for 
the classification of nonequilibrium phase transitions. 
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1. Entropy production in nonequilibrium steady states 



In classical statistical mechanics, complex systems are often modeled as continuous- 
time Markov processes. Such systems evolve by spontaneous random transitions from 
configuration c to configuration d according to certain rates w c ^ c /. While the specific 
trajectory of such a stochastic process is unpredictable, the probability P c (t) to find the 
system at time t in configuration c evolves deterministically according to the master 
equation [1] 

-P c (t) = J2( J ^c(t) ~ Jc^At)) , (1) 

den 

where J c ^ c i{t) = P c {t) w c ^ c / denotes the probability current flowing from configuration 
c to configuration d . 

A system is called stationary if its probability distribution P c {t) and therewith 
the currents J c ^c'{t) are time-independent. Moreover, if a stationary system obeys the 
additional condition of detailed balance 

Jo+d = Jc'^c , Vc, c , (2) 

meaning that all microscopic probability currents cancel pairwise, it is in a thermal 
equilibrium state. Otherwise, if the condition of detailed balance is violated, the system 
is said to be in a nonequilibrium steady state (NESS) [2]. In this case the system 
performs a biased random walk in its own configuration space, leading to nonvanishing 
probability currents as illustrated in Fig. 1. 

In nature nonequilibrium steady states cannot exist on their own, instead they can 
only exist in systems which are continuously driven from outside. In experiments this 
external drive usually manifests itself as a physical current such as a flow of heat or 
particles. On the level of the model the external drive is not implemented explicitly, it 
is rather encoded in the asymmetry of the rates w c ^ c r. 

While the internal entropy of a system in a NESS is on average constant, the 
external drive will continually produce entropy in the environment [3]. Remarkably, 
there exists a theoretical result which allows one to quantify this external entropy 
production without knowing the specific physical properties of the environment. In 
fact, based on previous works by Schnakenberg [4], Andrieux and Gaspard [5], it was 
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Figure 1. Markov process with three configurations A, B, C. The system is currently 
in state A and hops randomly as indicated by the arrows. Left: For symmetric rates 
the system performs an unbiased random walk in its state space and evolves into 
a stationary equilibrium state with Pa = Pb = Pc — 1/3 which obeys detailed 
balance. Right: For totally asymmetric rates the system evolves into a stationary 
state with the same probabilities. However, as the systems can only move clockwise, 
this state is characterized by nonvanishing probability currents and therefore it is out 
of equilibrium. In nature such a NESS requires that the system is constantly driven 
from outside. 



shown by Seifert [6, 7] that the environmental entropy production along a stochastic 
path of transitions c —> C\ —)■... at times t ,ti, . . . is given by 



Senv = V^-^m^^. (3) 

/ — ' w, 



In a numerical simulation of a given model, where the rates are known, the entropy 
production can be measured very easily by adding up all discontinuous changes 



AS cnv (c^c') = ln^ (4) 

Wc>->c 

whenever the system hops from c to c'. In the long-time limit these entropy fluctuations 
obey the fluctuation theorem P(— AS) = e~ AS P(AS) which implies that the entropy 
production is on average positive. Averaging Eq. (3) over many possible paths one 
obtains the mean entropy production rate 

(c -)■ d) , (5) 

which can be evaluated if the stationary probabilities P c are known [8,9]. In lattice 
models the entropy production usually scales with the number of sites L, allowing us to 
define the average entropy production rate per site 

■Senv ~J~{Scnv'} ■ (6) 



2. Motivating the entropy production formula 



For readers who are not familiar with the concept of entropy production we start with a 
derivation in the limit of fast equilibration in the environment, following a more extended 
presentation given in Ref. [10]. 
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Isolated systems: In classical statistical physics a complex system is usually modeled 
as a set Q of configurations c G f2, in which the system is assumed to hop spontaneously 
between different configurations according to certain rates w c ^ c '. Starting point of 
equilibrium statistical physics is the equal a priori postulate, which states that an 
isolated system always evolves into a stationary state of maximal entropy, meaning 
that all configurations are visited with the same probability P c = l/|fi|. Moreover, as 
the underlying closed quantum system is invariant under time reversal, one can show 
that the stationary state of an isolated system obeys detailed balance, meaning that the 
rates of an isolated system are always symmetric, i.e. w c ^ c / = u> c '_> c . 

Open systems: If a system interacts with its environment, the system together 
with its environment can be considered in itself as a large isolated system ('Universe') 
which relaxes into a state of maximal entropy. Let us denote the configurations of this 
combined system by u G f2 tot and the configurations of the contained laboratory system 
as c G fi sys . Clearly, for a given state c of the laboratory system the environment 
can be in many different possible states. This means that there exists a projection 
7r : Q tot i — y f2 sys , mapping each state u of the total system onto the corresponding state 
c = it (u) of the laboratory system. 

Dynamically connected sectors: If the laboratory system is in configuration c, 
the configuration of the total system will belong to the subspace 7r _1 (c) = {u G 
f2 sys |7r(-u) = c}. As illustrated in Fig. 2, this subspace generally decomposes into 
many dynamically separated sectors. As long as the laboratory system stays in c, 
the environment can only evolve within the actual sector, while a change to a different 
sector requires the laboratory system to evolve through a closed cycle from c over various 
intermediate configurations back to c. In the following we denote by tt^ 1 the current 
sector of dynamically connected system states which are compatible with the current 
configuration c for a given temporal evolution in the past. 

Reduced rates: The probability distribution P u (t) of the full system consisting of 
laboratory system and environment evolves according to the master equation 



where J u ^. u >{t) = P u (t)w u ^ u > denotes the probability current flowing from u to vl . Since 
the total system is assumed to be isolated, the rates have to be time-independent and 
symmetric, i.e. 



Likewise, the probability distribution P c (t) of the laboratory system evolves according 
to a master equation 




(7) 



u> 



w u—>-u' — w u'->u ■ 



(8) 




(9) 



e'en, 



■sys 
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Figure 2. Illustration of a nonequilibrium system with three configurations (red, 
green and blue) and biased rates. A given configuration, say the red one, is compatible 
with many different red states in the total system which are arranged in dynamically 
separated sectors. To move from one sector to the other, the laboratory system has 
to change its configuration. The effective bias of the rates in the laboratory system is 
caused by an ever increasing number of the corresponding available configurations in 
the respective sector of the total system. 



with the probability currents J c ^d = P c (t)w c ^ c '(t). Obviously, this reduced evolution 
equation is only compatible with the equation (7) of the total system if 

P c (t) = £ P u (t) , J^(t) = J u-±u>{t). (10) 

USiTtJ (6) uGir7 1 (c) 

This implies that the reduced rates Wc-^dif) in the laboratory system are given by 

It is important to note that the reduced rates are generally time-dependent. However, 
experiments are often designed in such a way that the rates are effectively kept constant 
during the observation time. 

Separation of time scales: The easiest way to derive the formula for entropy 
production AS env = In ^ c ~ w is to assume that the environment is in thermal 
equilibrium and equilibrates almost instantaneously within its dynamically accessible 
sector whenever the laboratory system changes its configuration. This means that for a 
given configuration c of the laboratory system, all configurations u G 7r7 1 (c) are equally 
probable, i.e. 

Pu(t) = Vu 6 n;\c) (12) 

where N c (t) = |7r ; 7 1 (c)| is the number of states in the current dynamically accessible 
sector in the total system. Inserting this equation into Eq. (11), the reduced rates are 
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given by 

in . = 

N c (t) 



w c ^c'(t) = —— W ^> (13) 



so that the quotient of mutually reverse transition rates can be expressed by a ratio of 
the number of states 

w c ^{t) NAt)_ 

«V-c(*) N c (t) ' 1 ) 

where we used the symmetry w u ^ u r = uy_> M of the rates in the (isolated) total system. 



Entropy production in the environment: In the limit of a quasi-instantaneous 
equilibration the entropy in the environment for a given c is simply given by 

Senv(c) = lniV c (t). (15) 

Whenever the system jumps from c — > c', the environmental entropy thus changes by 

ASUc^c) = In^ = In^^y. (16) 

Along a stochastic path 7 : cq — > c\ — >■ . . . of transitions taking place at to,t\, . . ., the 
temporal derivative of the entropy in the environment is therefore given by [6] 

s cnv = E^-^) ln ?^! ( 17 ) 

j W Cj+1 ^, Cj (l) 

which reproduces formula (3) in the Letter. Averaging (17) over all possible paths gives 
the average entropy production rate in Eq. (5): 

w c -+c>(t) AS env (c -> c'). (18) 

c+c' 

If the laboratory system is stationary, the t-dependence on the r.h.s. can be dropped. 



The problem of infinite entropy production: For irreversible transitions, where 
w Cj -+ Cj+1 > and w Cj+1 ^ Cj = 0, the logarithm in Eq. (17) diverges, meaning that 
such a transition would instantaneously produces an infinite amount of entropy. In 
fact, in the setting discussed above, an irreversible transition would correspond to an 
infinite increase of the number of states in the environment. However, in the laboratory 
we can realize irreversible processes experimentally without seeing an infinite entropy 
production, which would result into a divergent increase of heat in the environment. 
In the Letter we argue that this apparent paradox can be overcome by realizing that 
microscopically irreversible rates are in principle impossible in nature. However, we can 
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design an experiment in such a way that the reverse transition so strongly suppressed 
that it practically never occurs during the life time T of the experiment. However, 
observing that a particular transition does not occur in an experimental realization 
during a finite time T of data taking, we cannot conclude that the actual rate was exactly 
zero, all what we can say is that this rate of the order of 1/T or smaller. Therefore we 
suggest that the actual rate in the experiment is small but positive, leading to a finite 
entropy production with a lower bound that grows logarithmically with T. The slow 
logarithmic dependence in T explains why we practically do not see an infinite entropy 
production in nature. 

The argument can also be spelled out in a different way: In nature it is in 
principle impossible to design experiments with irreversible processes. However, we 
can approximate irreversible processes quite well in experiments, but the effort to do 
this (reflected in the entropy production) grows only logarithmically with the timescale 
of the rate which is sent to zero. In other words, the better we approximate a zero 
rate experimentally, the more entropy the experimental setup will generate in the 
environment, but the entropy grows so slowly that a divergence in the limit of a vanishing 
rate is not seen in practice. 

3. Full derivation of the entropy production for irreversible processes 

In the paper we presented a simplified derivation of the irreversible entropy production, 
where we used the mathematically incorrect replacement (\nw) — > \n(w). Here we 
present the full derivation, showing that in the present case one obtains essentially the 
same result. 

As in the main text we consider a particular pair of states c, c' with a defining 
rate w = w c _> c > and denote by r = P C T the average time spent in configuration c 
during data taking. With the likelihood P(n\w) = {jw) n e~ TW jn\ and its conjugate 
prior P(w) = $ a w a ' 1 e~^ w /T(a) the normalizing marginal likelihood P(n) in Bayes' 



rule 




(19) 



is given by 




(20) 



T n (3 a F(n + &) 



Inserting this 



(T + ^+«r(i + n)r(«)' 

result into Eq. (19) we obtain the posterior 
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which describes the expected distribution of the actual rate w for a given number 
of events n during the observation time T under the assumption that the rates are 
distributed according to the prior with certain hyperparameters a, (5. In the Letter we 
first compute the expectation value of the actual rate 

/oo _ 
dww ^ P(w\n)P(n\w) = — — " (22) 

for which one can easily show that the integration and the infinite sum commute. This 
result is then plugged into the entropy production formula for the actual rates 

AS cnv (c^c') = lnj^=4, (23) 

giving 

{In Wc ^ d for reversible transitions, 
tpT (24) 
In — d w c^c' f or irreversible transitions. 
a 

for large observation time T>1. However, this simplified calculation is incorrect since 
we have replaced 

(lnw) m(w) (25) 

in the entropy production formula, but the arithmetic average does not commute with 
a nonlinear function. In a correct derivation, the logarithm should be taken before 
averaging over w and n. In fact, using Mathematica™ one can show that 

poo 

(\nw\n) = / dw In w P(w\n) = ip(n + a) — ln(r + (3) , 
Jo 

where ip(z) denotes the digamma function. This leads to 

oo 

(\nw) = ^^(\nw\n)P(n\w) (26) 

n=0 

d 

= ip(a) - ln(r + (3) - — iF x (a; a; -rw) , 

C>a a=0 

where \Fi(a; b; z) is the Kummer confluent hypergeometric function. Again one can show 
that the integral over w and the infinite sum over n commute. By defining r' = P c /T 
and inserting this result into the entropy production formula we obtain 

AS^ = (\nw c ^ c >) - (lnw c >^ c ) (27) 

= - (ln(r + ^-ln(r' + ^) 



a=0 
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For a > the Kummer confluent hypergeometric function has the integral representation 

m r 

T(a)T(b - a) J 



iFi(a; b; z) = ^ / e zu u a -\l - uf-^ 1 du (28) 



with the derivative 
d_ 
da 



\b-a-l 



iF!(a; b; z) = ^) / e^V^l - uf 
T(a)T(b-a) J 

x ^(6-a)-^(a)-2tanh- 1 (l-2M))dM. (29) 

While each of the Kummer functions in this representation would diverge when taking 
a — > 0, it turns out that their difference remains finite. The resulting integral is given 
by 



u c->c' 



AS cnv = In — + / 1 ^ dM . (30) 

r + /3 Jo u[l-uy 

This integral can be evaluated for an arbitrary a. For large observation time T ^> 1 the 
entropy production given by (30) behaves asymptotically as 

{} n w c^c> f or reversible transitions, 
W r l. r 
(31) 
In — c ' Wc ^ c ' for irreversible transitions. 

where ocr = exp('0(a)) replaces the a-hyperparameter. Hence, by commuting the 
logarithm and the average, we obtain to leading order the same result with a redefined 
hyperparameter a. 

For the special case a = 1 the entropy production (30) can be calculated exactly 
and results in 

AScnv = In + T(0, ruw) - r(0, rV->c) + In §^=^- (32) 

in which T(s, z) is the incomplete gamma function. For reversible transitions, the 
incomplete gamma function r(0, tw) vanishes exponentially in the limit T — > oo and can 
be neglected, hence the calculation reproduces the usual entropy production formula. 
For irreversible transitions with w c /^ c = 0, however, we obtain 

t' + (3 

AS cnv = In ~ + 7 + r(0,rw c ^ c /) + \n(rw c ^ d ) , (33) 

r + 8 

where 7 is Euler's constant. In the long time limit the incomplete gamma function goes 
to zero exponentially, hence the first and the last terms give the entropy production for 
irreversible transitions. 
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4. Entropy production in systems with matrix product steady states 

There are families of one-dimensional stochastic nonequilibrium systems, such as driven 
diffusive systems, for which the exact steady state probability distribution can be 
expressed in a matrix product form. In what follows we briefly review the matrix 
product method (for a complete review see [21]) and show how we can calculate the 
entropy production in a simple one-dimensional stochastic nonequilibrium system. 

Let us consider a one-dimensional lattice with L lattice sites and open boundaries. 
To each lattice site i we assign an occupation number q associated with different states 
of that lattice site. The idea is to associate an operator with each possible state of 
a lattice site and write the unnormalized steady state weight of a given configuration 
c = {ci, • • • , Cl) for periodic boundary conditions as 

P c <xTr(D cl D C2 ---D CL ). (34) 

and for open boundaries as 

P c cx(W\D cl D C2 ...D CL \V). (35) 

with appropriate vectors \ V) and (W\. Requiring (35) to satisfy the master equation (9) 
in the steady state 

^2 PcWc-^d = ^2 p c w c^c ( 36 ) 

determines the relation between the noncommuting operators and the vectors \V) and 
(W\. 

As a simple example let us consider the Totally Asymmetric Simple Exclusion 
Process (TASEP) with open boundaries [22]. The dynamical rules are 

10 -> 01 with rate 1 

— > 1 at the left boundary with rate a (37) 

1 — > at the right boundary with rate f3. 

As a two-state system we associate the operators D = E and D\ = D with an empty 
lattice site (q = 0) and an occupied lattice site (q = 1) respectively. These operators 
besides the vectors \V) and (W\ satisfy the following quadratic algebra [22] 

DE = D + E 

D\V) = \\V) (38) 



(W\E=l(W\. 
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It is known that the algebra (38) has an infinite-dimensional matrix representation. 
Note that all of the transitions in the TASEP are irreversible, hence using (5) and (31) 
the average entropy production to leading order in T can be written as follows 

L-l 

(-S'env) ~ ( a P{0c 2 -c L } + ^ ^ P \c l C2-c i - 1 Wc i+2 -c L } 
{c} i=l {c} 

+ ^/3P {ci ... CL _ ll} )lnT. (39) 

The first and the last terms in (39) are contributions of the boundaries in the average 
entropy production while the second term comes from the diffusion of particles in the 
bulk of the lattice. Using the algebra (38) the corresponding probabilities in (39) can 
be calculated 

L-l 

^2 ^2 - P {ciC2-c l _ 1 10c l+2 -c i } (41) 
i=l {c} 

^ (WIC^DEC^IV) _ Z L _x 

i=i 

fr P{c — 1} " — y l — - j~zr- (42) 

in which we have defined C = E + D. The normalization factor Z L is given by [22] 



L 



^^^^^ 



k(2L- k- l)\[3~ k - 1 -a 



-fc-i 



The current of particles between the lattice sites i and i + 1 can be written as 



(43) 



Using the algebra (38) we can easily see that the stationary state current of particles is 
site-independent and is given by 

«/(«,/*) = (45) 

In the thermodynamic limit L — > oo it is clear that the contribution of the bulk reaction 
in the average entropy production is dominant, resulting in 

l(S env ) « J(a,/3)]nT (46) 
which recovers the result obtained in the Letter. 
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Using the same procedure explained above one can, in principle, calculate the 
average entropy production of any stochastic nonequlibrium system given that its 
stationary state probability distribution can be obtained using the matrix product 
method. As it is mentioned in the Letter, we have used a two-dimensional matrix 
representations for the associated quadratic algebras of the Branching- Coalescing 
Process and the Asymmetric Kawasaki-Glauber Process to calculate the average entropy 
production in these systems. 



5. Further examples and applications 

5.1. Chemical rate equations 

Rate equations for chemical reactions describe the temporal evolution of concentrations 
of particles. For example, the Lotka-Volterra equations 

[X] = a[X] - f3[X][Y] (47) 
[Y] = - 1 [Y] + 8[X}[Y] (48) 

describes the interaction of a prey population [X] and a predator population [Y] and 
exhibits oscillatory solutions for suitable parameters. 

Chemical evolution equations of this kind are mean field approximations in which 
the spatial dependence is ignored. They are often formulated as if the underlying 
chemical reactions were irreversible. For example, the Lotka-Volterra would correspond 
to the reaction scheme 

X^aXX, XY^f3Y, Y ->■ 7 0, XY — >■ 5XYY. (49) 

If no information about reverse rates are available, our result allows us to quantify the 
irreversible entropy production rate by 

(S env ) = [*]aln(H^) + [X][F]/31n(l^) (50) 

+ [yhM ^ ) + [ x 1[yl 5 M mi). 

a R a R 
For an oscillatory solution the entropy production would oscillate as well. 



5.2. Contact process 

The 1+1-dimensional contact process is a nonequilibrium process which is frequently 
used as a simple model for epidemic spreading [23,24]. It evolves by random-sequential 
updates, i.e. a pair of adjacent sites is randomly selected and the following processes 
are carried out (cf. Fig. 3): 

01 ->■ 11 with rate A/2 
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X/2 X/2 [i/2 [i/2 1/2 1/2 

offspring production coagulation removal (death) 

Figure 3. Dynamical rules of the contact process. Offspring production and 
coagulation are reversible while the death process is irreversible. The model exhibits 
a nonequilibrium phase transitions. 

10 11 with rate A/2 

11 ^ 01 with rate fi/2 
11 10 with rate /i/2 

01 — ^ 00 with rate 1/2 
10 00 with rate 1/2 

The standard version of the contact process in 1+1 dimensions with /i = 1 is known to 
exhibit an absorbing phase transition at the critical point A c = 3.29785(2) [25]. In the 
two-parameter version defined above there is a critical line of transitions (see Fig. 4). 
Except for the lower terminal point at A = 1, ji — 0, where the dynamics is the same as 
in a Glauber-Ising model at zero temperature, all transition points along this line are 
expected to belong to the universality class of directed percolation (DP) [26]. 

Although models in the DP class are nonintegrable, the entropy production of this 
model can be related exactly to the actual particle density. To see this let P Ci , Ci+1 be the 
probability to find a randomly selected pair of sites i, i + 1 in the states q, Cj+i. Clearly, 
these probabilities are left-right symmetric 

Poi = Pio (51) 
and normalized by 

P 00 + P i + Pio + Pn = 1 ■ (52) 

Moreover, the average particle density can be computed by integrating out one of the 
sites, i.e. 

p = P 00 + P 10 . (53) 

According to the dynamical rules defined above, the first four processes increase the 
particle number by one, whereas the last two processes decrease the particle number by 
one. Therefore, the density of particles will change in time as 

p=(P 01 + P 10 )^-^ii (54) 

In the stationary state, where p = 0, Eqs. (51)-(54) provide four equations, giving the 
two-site probabilities 

^oi = Pio = , _/ T P , Pxi = ^~\ p (55) 
A + /j, — 1 A + fi — 1 
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Figure 4. Two-parameter contact process in 1+1 dimensions. Left: Phase diagram 
with a phase transition line. Right: Reversible and irreversible entropy production rate 
over T — 10 Monte Carlo sweeps divided by the particle density along the transition 
line (see text). 



which allow us to derive the following exact relations for the reversible and irreversible 
entropy production rate: 

fb + ih, /flgTx = AP , / (l _ p i-A-2^ r 



2a,R / A + /i — 1 \V 1 — A — ji J 2a>R / 
Near criticality, where P o ~ 1, both parts of the entropy production are proportional 
to the density of particles p, i.e. 

c;/P-f^4 (56) 

A + p — 1 A + / u— 1 

These quotients vary along the transition line, as shown in the right panel of Fig. 4. 



5.3. Growth process with roughening transition 

As another example, let us consider a model of a growing 1+1-dimensional interface 
which exhibits a roughening transition [27]. The configuration of the model is described 
by an interface in terms of a height variable hi G Z at the sites i = 1, . . . , L. In addition, 
it is assumed that the interface obeys the restricted solid-on-solid (RSOS) condition 

|^+i - h\ < 1. (57) 

As illustrated in Fig. 5, the model evolves random-sequentially by deposition of particles 
with rate q and spontaneous removal with rate 1. As a special feature, evaporation from 
plateaus is forbidden, which means that one of the backward rates vanishes (the entropy 
production for a reversible non-zero rate was studied in [28,29]). This vanishing rate, 
which is marked by a red cross in Fig. 5, ensures that a layer, once completed, cannot be 
evaporated again, pinning the interface at a spontaneously selected height if the growth 
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Figure 6. Model for interface growth. Left: Growth velocity as a function of the 
parameter q, indicating the unbinding transition at q c « 0.4. Right: Reversible and 
irreversible entropy production produced by a system with L = 10 4 sites monitored 
over T = 10 6 Monte Carlo sweeps (see text). 



rate is very small. However, when the growth rate exceeds a certain critical threshold at 
q c « 0.4 the interface unbinds from the bottom layer, leading to a roughening transition. 
In the moving phase the interface has a finite average velocity v = (h) > 0, as shown in 
the left panel of Fig. 6. 

The first three processes shown in Fig. 5 are reversible and therefore contribute 
with AS env = ±lng for deposition and evaporation, respectively. The last process, 
however, is irreversible and contributes with ln(pj(g)gT/<5#), where Pf{q) denotes the 
probability to find three adjacent sites at the same height. These contributions are 
added up whenever the respective processes take place. 

The result is shown in the right panel of Fig. 6. Interestingly, the reversible part of 
the entropy production exhibits a local maximum at the transition point, whereas the 
irreversible part of the entropy production is completely insensitive to the transition. 
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